In THE Claims; 



Claims pending 



• At time of the Action: 



Claims 1-40. 



• After this Response: 



Claims 1-4, 6-14, 16-18, 20-30, and 32- 



41. 

Currently Amended claims: Claims 1, 6, 8, 10-1 1, 16, 21, 23-26, 28, 

33, 35-38, and 40. 
Currently Canceled claims: Claims 5, 15, 19, and 31. 



1. (Currently Amended) A method comprising: 

modeling an image with respect to multiple visual attentions to generate a 
respective set of attention objects (AOs) for each attention of the visual attentions; 

analyzing the attention objects and corresponding attributes to optimize a 
rate of information gain as a function of information unit cost in terms of time 
associated with multiple image browsing modes , wherein the corresponding 
attributes for each attention object of the AOs comprise a minimal perceptible time 
for display of subject matter associated with the attention object :[[ and]] 

responsive to analyzing the attention objects, generating a browsing path to 
select ones of the attention objects , th e browsing path b e ing a trad e off of tim e for 
spac e or spac e for tim e .i md 

causing display of subject matter associated with each of the selected ones 
of the attention objects for at least a respective minimal perceptible time by 
panning the image according to the generated browsing path. 



New claims: 



Claim 41. 
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2. (Original) A method as recited in claim 1, wherein the multiple visual 
attentions are based on saliency, face, and text attention models. 

3. (Original) A method as recited in claim 1, wherein the image browsing 
modes comprise a perusing mode and a skimming mode. 

4. (Original) A method as recited in claim 1, wherein the select ones have 
relatively greater information fidelity as compared to different ones of the attention 
objects. 

5. (Canceled) 

6. (Currently Amended) A method as recited in claim 1, wh e r e in th e 
corr e sponding attributes for each attention object of the attention obj e cts comprise 
a minimal p e rc e ptibl e tim e (MPT) for display of subject matt e r associat e d with th e 
att e ntion obj e ct, and wh e r e in th e m e thod furth e r comprises: further comprising: 

calculating the MPT as a function of: 

• a number of words in the subject matter; 

• whether the subject matter is for presentation to a viewer in a perusing 
image browsing mode or a skimming image browsing mode; 

• user preferences; and/or, 

• display context. 
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7. (Original) A method as recited in claim 1 , wherein modeling further 

comprises: 

creating a visual attention model for the image, the visual attention model 
being generated according to 

{AO.}={(ROI., AV., MPS.,MPT.)}, 1</<7V; and, 

wherein ^Oi, represents an AO within the image, ROIt represents a 
region-of-interest of AO,, AV, represents an attention value of AOf, MPSi 
represents a minimal perceptible size of AOi, MPTi represents a minimal 
perceptual time for display of subject matter associated with the AOi, and, N 
represents a total number of AOs modeled from the image. 

8. (Currently Amended) A method as recited in claim 1 , wherein the browsing 
path comprises a number of successive path segments described as follows: 

P = {P.} = {(SP„EP„SR„ER„T^}, l<i<N, and 

wherein Pf represents an i^'' path segment, SPi represents a starting point of Pj , 

[[EP]] EPi corresponds to an ending point of Pi , SRi is a starting resolution of Pi , 
ERi is an ending resolution of P, , and ^ is a time cost for scrolling from SPi to EPi . 

9. (Original) A method as recited in claim 1, wherein generating the browsing 
path further comprises creating the browsing path as a function of a fixation state 

or a shifting state. 

10. (Currently Amended) A method as recited in claim 1, wherein generating 
the browsing path further comprises calculating an information fidelity for each 
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AO, the information fidelity being a function of an attention value (AV) and 
[[a]]tlie minimal perceptible time (MPT) for display of subject matter associated 
with the AO. 

11. (Currently Amended) A method as recited in claim 1 : 

wherein each AO is a respective information block and wherein the image 
(I) is a modeled as a set of M x N evenly distributed information blocks ly as 
follows: 

/ = {/,, } = {(A , )}, l<i<M,\<j< N, ry e (0,l) , 

wherein (i, j) corresponds to a location at which the information block ly is 
modeled according to a visual attention, ^4 is a visual attention value of 7^, is 
the spatial scale of ly, representing the minimal spatial resolution to keep ly 
perceptible; and, 

wherein generating the browsing path further comprises calculating an 
information fidelity ifRsvp) for each AO, the information fidelity being calculated 
as follows for respective ones of the information blocks lif. 

T 

fRSVP iI^T) = \ X ^ VijU{r{t) - )dt, Irsvp (0 c / ; and 

0 lijelRsvpit) 

wherein lRsvp(t) is a subset of the information blocks and varies with time 
(I) and 

^ ■ ( Widths„^^ Heights,,,,^ 1 , • , • 
rit) = max r. < mm xr:een_ ^creen_ ^jjjch varies with space. 
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12. (Original) A method as recited in claim 1 , wherein generating the browsing 
path further comprises creating the browsing path in view of a skimming image- 
browsing mode as follows: 

splitting one or more large AOs of the AOs into smaller AOs; 
combining AOs in close proximity to one another into one or more attention 
groups; 

arranging the attention groups in decreasing order based on respective 
attention values; 

for each attention group of the attention groups: 

selecting the attention group as a starting point; 
calculating a total browsing time and information fidelity for each 
path of all possible paths from the starting point; and 

if the total browsing time is greater than a browsing time threshold, 
discarding the path; 

selecting a non-discarded path having a largest information fidelity as the 
browsing path, the browsing path connecting each of the attention groups. 

13. (Original) A method as recited in claim 1, wherein generating the browsing 
path further comprises creating the browsing path in view of a perusing image- 
browsing mode as follows: 

splitting one or more large AOs of the AOs into smaller AOs; 
combining AOs in close proximity to one another into one or more attention 
groups; 

arranging the attention groups in decreasing order based on respective 
attention values; 
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for each attention group of the attention groups: 

selecting the attention group as a starting point; 

for each path of all possible paths from the starting point: 

calculating a total browsing time and an information fidelity; 

and 

if the information fidelity is smaller than a browsing time 
threshold, discarding the path; 

selecting a non-discarded path having a smallest browsing time as the 
browsing path, the browsing path connecting each of the attention groups. 

14. (Original) A method as recited in claim 1 , further comprising: 

detecting user intervention during automatic playback of the browsing path; 
responsive to detecting the user intervention: 

recording all AOs Sr of the AOs that have not been browsed ; 

identifying all AOs of the AOs browsed during the user 

intervention; 

regenerating the browsing path based on Sr - S^; and 

responsive to regenerating the browsing path and determining that 

there is at least a lull in user intervention, automatically navigating the browsing 

path. 

15. (Canceled) 
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16. (Currently Amended) A computer-readable medium comprising computer- 
program instructions executable by a processor for: 

modeling an image with respect to multiple visual attentions to generate a 
respective set of attention objects (AOs) for each attention of the visual attentions, 
the AOs representing respective regions of the image; 

analyzing the attention objects and corresponding attributes to in view of a 
model for human browsing behavior, the model comprising fixation and shifting 
states, in the fixation state an interesting region of the regions is exploited for 
information, in the shifting state one region of the regions is replaced with another 
region of the regions as a function of image view manipulation operations such as 
scrolling or tabbing operations , and wherein the corresponding attributes for each 
attention object of the AOs comprise a minimal perceptible time for display of 
subject matter associated with the attention object ;[[ and]] 

responsive to the analyzing, optimizing a rate of information gain in terms 
of space as a function of information unit cost in terms of time associated with the 
model for human browsing behavior to generate a browsing path to select ones of 
the attention objects; 

causing display of subject matter associated with each of the selected ones 
of the attention objects for at least a respective minimal perceptible time by 
panning the image according to the generated browsing path . 

17. (Original) A computer-readable medium as recited in claim 16, wherein the 
multiple visual attentions are based on saliency, face, and text attention models. 
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18. (Original) A computer-readable medium as recited in claim 16, wherein the 
select ones have relatively greater information fidelity as compared to different 
ones of the attention objects. 

19. (Canceled) 

20. (Original) A computer-readable medium as recited in claim 16, wherein the 
computer-program instmctions further comprise instructions for generating the 
browsing path as a number of successive path segments as follows: 

P = {P.} = {(SP„EP„SR„ER„T^}, l<i<N, and 

wherein Pi represents an f' path segment, SPi represents a starting point of Pi, EP 
corresponds to an ending point of Pi , 57?, is a starting resolution of Pi , ERi is an 
ending resolution of , and Ti is a time cost for scrolling from SPi to EPi . 

21. (Currently Amended) A computer-readable medium as recited in claim 16, 

wherein the computer-program for generating the browsing path further comprise 
instructions for calculating an information fidelity for each AO, the information 
fidelity being a function of an attention value (AV) and [[a]]tiie minimal 
perceptible time (MPT) for display of subject matter associated with the AO. 

22. (Original) A computer-readable medium as recited in claim 16, wherein 
each AO is a respective information block, and wherein the computer-program 
instructions further comprise instructions for: 
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representing the image (7) as a set of Mx N evenly distributed information 
blocks lij as follows: 



wherein (i, j) corresponds to a location at which the information block ly is 

modeled according to a visual attention, A Vjj is a visual attention value of ly, r y is 
the spatial scale of ly, representing the minimal spatial resolution to keep ly 
perceptible; and, 

generating the browsing path further by calculating an information fidelity 

ifRsvp) for each AO as follows for respective ones of the information blocks 7^: 



f^YP ^) = J E ^ yijUirit) - )dt, Irsvp (0 c / ; and 
wherein Irsvp(0 is a subset of the information blocks and varies with time 

and 



/ = {Iij} = {(AVij,rij)\, l<i<M,l<j<N,rye (0,l), 



T 



r(t) = max r.. < min 



Widthj^^^^,^ ' Height J 



, which varies with space. 
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23. (Currently Amended) A computer-readable medium as recited in claim 16, 
wherein the computer-program instructions for optimizing further comprise 
instructions for determining the rate of information g ain R as follows: 



wherein, G is a total net amount of objectively valuable information gained as 

determined via information fidelity determinations, is a total amount of time 
spent on shifting between subsequent fixation areas (AOs), Tw represents an 
exploiting cost, which is a total duration of the MPTs used while in a fixation state. 

24. (Currently Amended) A computer-readable medium as recited in claim 23, 
wherein the computer-program instructions further comprise instructions for 
optimizing the rate of information g ain R either by maximizing information fidelity 
or by minimizing time cost. 

25. (Currently Amended) A computer-readable medium as recited in claim 23, 
wherein the computer-program instructions further comprise instructions for 
optimizing the rate of information g ain R in the shifting mode as follows: 



wherein, Tp represents a total amount of time spent for fixation and shifting in the 
browsing path P, It is a threshold of maximal time cost, and / represents the 
image. 



Given 
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26. (Currently Amended) A computer-readable medium as recited in claim 23, 
wherein the computer-program instructions further comprise instructions for 
optimizing the rate of information g ain R in the shifting mode as follows: 

Given fp{I,Tp)> X^y, Min{Tp], 

wherein, Tp represents a total amount of time spent for fixation and shifting in the 
browsing path P, X^y represents a minimal attention value or information 
percentage for attainment. 

27. (Original) A computer-readable medium as recited in claim 16, further 
comprising: 

detecting user intervention during automatic playback of the browsing path; 
responsive to detecting the user intervention: 

recording all AOs Sr of the AOs that have not been browsed ; 

identifying all AOs of the AOs browsed during the user 

intervention; 

regenerating the browsing path based on Sr - S„; and 

responsive to regenerating the browsing path and determining that 
there is at least a lull in user intervention, automatically navigating the browsing 
path. 

28. (Currently Amended) A computing device comprising a processor coupled 
to a memory, the memory comprising computer-program instructions executable 
by the processor for: 
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modeling an image with respect to multiple visual attentions to generate a 
respective set of attention objects (AOs) for each attention of the visual attentions, 
the AOs representing respective regions of the image; 

analyzing the attention objects and corresponding attributes to in view of a 
model for human browsing behavior, the model comprising fixation and shifting 
states, in the fixation state an interesting region of the regions is exploited for 
information, in the shifting state one region of the regions is replaced with another 
region of the regions as a function of image view manipulation operations such as 
scrolling or tabbing operations , and wherein the corresponding attributes for each 
attention object of the AOs comprise a minimal perceptible time for display of 
subject matter associated with the attention object ;[[ and]] 

responsive to the analyzing, optimizing a rate of information gain in terms 
of space as a function of information unit cost in terms of time associated with the 
model for human browsing behavior to generate a browsing path to select ones of 
the attention objects ; and 

causing display of subject matter associated with each of the selected ones 
of the attention objects for at least a respective minimal perceptible time by 
panning the image according to the generated browsing path . 

29. (Original) A computing device as recited in claim 28, wherein the multiple 
visual attentions are based on saliency, face, and text attention models. 

30. (Original) A computing device as recited in claim 28, wherein the select 
ones have relatively greater information fidelity as compared to different ones of 
the attention objects. 
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31. (Canceled) 



32. (Original) A computing device as recited in claim 28, wherein the 
computer-program instructions further comprise instructions for generating the 
browsing path as a number of successive path segments as follows: 

P = {P.} = {(SP,,EP.,SR,,ER.,T.)}, l<i<N, and 

wherein Pi represents an i^'' path segment, SPi represents a starting point ofP,, EP 
corresponds to an ending point of Pi , SRi is a starting resolution of Pi , ERi is an 
ending resolution of Pi ^ and Ti is a time cost for scrolling from SPi to EPi . 

33. (Currently Amended) A computing device as recited in claim 28, wherein 
the computer-program for generating the browsing path further comprise 
instructions for calculating an information fidelity for each AO, the information 
fidelity being a function of an attention value (AV) and [[a]]the minimal 
perceptible time (MPT) for display of subject matter associated with the AO. 

34. (Original) A computing device as recited in claim 28, wherein each AO is a 
respective information block, and wherein the computer-program instructions 
further comprise instructions for: 

representing the image (7) as a set of Mx A/^ evenly distributed information 
blocks lij as follows: 

/ = {7^} = [{AVij,rij)\, l<i<M,l<j<N,rije (0,l), 
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wherein (i, j) corresponds to a location at which the information block ly is 
modeled according to a visual attention, A Vy is a visual attention value of ly, r y is 
the spatial scale of ly, representing the minimal spatial resolution to keep ly 
perceptible; and, 

generating the browsing path further by calculating an information fidelity 
(/rsvp) for each AO as follows for respective ones of the information blocks li/. 

T 

/rsvp (I,T) = l ^ ^ Viju(r(t) - )dt, I rsvp (0^1; and 

oiijeiRsvpiO 

wherein Irsvp(0 is a subset of the information blocks and varies with time 

and 

■ ( Width..,.^^„ HeighL^^^„ 1 1 . 1 
r(t) = max r. < mm ^ which varies with space. 
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35. (Currently Amended) A computing device as recited in claim 28, wherein 
the computer-program instructions for optimizing further comprise instructions for 
determining the rate of information g ain R as follows: 



wherein, G is a total net amount of objectively valuable information gained as 

determined via information fidelity determinations, is a total amount of time 
spent on shifting between subsequent fixation areas (AOs), Tw represents an 
exploiting cost, which is a total duration of the MPTs used while in a fixation state. 

36. (Currently Amended) A computing device as recited in claim 35, wherein 
the computer-program instructions further comprise instructions for optimizing the 
rate of information g ain R either by maximizing information fidelity or by 
minimizing time cost. 

37. (Currently Amended) A computing device as recited in claim 35, wherein 
the computer-program instructions further comprise instructions for optimizing the 
rate of information g ain R in the shifting mode as follows: 



wherein, Tp represents a total amount of time spent for fixation and shifting in the 
browsing path P, It is a threshold of maximal time cost, and / represents the 
image. 



Given 
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38. (Currently Amended) A computing device as recited in claim 35, wherein 
the computer-program instructions further comprise instructions for optimizing the 
rate of information g ain R in the shifting mode as follows: 

Given fp{I,Tp)> X^y, Min{Tp), 

wherein, Tp represents a total amount of time spent for fixation and shifting in the 
browsing path P, X^y represents a minimal attention value or information 
percentage for attainment. 

39. (Original) A computing device as recited in claim 28, further comprising: 
detecting user intervention during automatic playback of the browsing path; 
responsive to detecting the user intervention: 

recording all AOs Sr of the AOs that have not been browsed ; 
identifying all AOs Sm of the AOs browsed during the user 

intervention; 

regenerating the browsing path based on Sr - S^, and 

responsive to regenerating the browsing path and determining that 

there is at least a lull in user intervention, automatically navigating the browsing 

path. 

40. (Currently Amended) A computing device comprising: 

means for determining respective attention value and image fidelity of 
attention objects derived from an image, specified minimal amounts of size and 
time conditions under which to present the attention objects to a user, and user- 
browsing characteristics; 
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means for adapting the image for presentation on a small display device to 
present objectively interesting portion(s) of the image based in part on display 
constraints of the device, and attributes of the attention objects;[[ and]] 

means for calculating a navigation path through the image that has been 
adapted for presentation on the small display device, the navigation path 
identifying a browsing path from one objectively important portion of the image to 
at least one other objectively important portion of the image, respective image 
portions being represented by individual ones of the attention objects, the browsing 
path being generated as a function of desired human browsing behavior associated 
with time and space : and 

means for causing display of the image by panning the image from the one 
objectively important portion of the image to the at least one other objectively 
important portion of the image . 

41. (New) A method comprising: 

modeling an image with respect to multiple visual attentions to generate a 
respective set of attention objects (AOs) for each attention of the visual attentions; 

analyzing the attention objects and corresponding attributes to optimize a 
rate of information gain as a function of information unit cost in terms of time 
associated with multiple image browsing modes; and 

responsive to analyzing the attention objects, generating a browsing path to 
select ones of the attention objects, the browsing path being a trade off of time for 
space or space for time; 

wherein generating the browsing path further comprises creating the 
browsing path in view of a skimming image-browsing mode as follows: 
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splitting one or more large AOs of the AOs into smaller AOs; 
combining AOs in close proximity to one another into one or more attention 
groups; 

arranging the attention groups in decreasing order based on respective 
attention values; 

for each attention group of the attention groups: 

selecting the attention group as a starting point; 
calculating a total browsing time and information fidelity for each 
path of all possible paths from the starting point; and 

if the total browsing time is greater than a browsing time threshold, 
discarding the path; 

selecting a non-discarded path having a largest information fidelity as the 
browsing path, the browsing path connecting each of the attention groups. 
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